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AMENDMENT UNDER ARTICLE 34 

Before preliminary international examination, please amend claims 1, 3, 5-23, 25, 27- 
29, 31, 33-51, 53, and 55-59 as follows: 

1 . A method for searching a collection of media objects, comprising: 

combining object information pertaining to a feature common to £&? a plurality of 
reference objects to produce composite reference information representing criteria for a 
search; and 

comparing the composite reference information to object information pertaining to the 
same feature for each respective one of a plurality of for media objects in a collection of 
media objects to identify one or more media objects in th e coll e ction of m e dia objects. ; 

wherein a non-Euclidian function is used either to combine the information pertaining 
to the feature, or to compare the composite reference information to information pertaining to 
the same feature. 



3. The method of claim 1, further comprising: 

selecting a media object in the collection of media objects based upon the comparison 
of the object information pertaining to the feature for each media object and the composite 
reference information. 



Applicant 
Serial No. 
Filed 
Page 



Adobe Sys^^^.xorporated 

PCT/US027PB8 

September 30, 2002 
2 




Attoi 



Docket No.:07844-558WOl 



5. The method of claim 4, wherein: 

combining obj e ct information pertaining to a feature common to fer a plurality of 
reference objects includes combining obj e ct information for different types of objects. 

6. The method of claim 1, wherein: 

combining object information pertaining to a feature common to fer a plurality of 
reference objects to produce composite reference information includes determining the 
intersection of the object information for the reference objects. 

7. The method of claim 1, wherein: 

combining object information pertaining to a feature common t o a plurality of 
reference objects to produce composite reference information includes determining the union 
of the object information for the reference objects. 

8. The method of claim 1, wherein further comprising : 

combining the object information pertaining to a second feature common to the 
plurality of reference objects charact e rizes f e atures of the r e f e rence objects and the m e dia 
obj e cts in th e coll e ction of m e dia objects to produce additional composite reference 
information representing criteria for the search; and 



comparing the additional composite reference information to information pertaining 
to the second feature for each respective one of the plurality of media objects in the collection 
of media objects to identify one or more media objects. 
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9. The method of claim 8, wherein: 

the obj e ct information pertaining to a feature and the information pertaining to a 
second feature is weighted to specify a relative importance of the features. 

1 0. The method of claim 8, further comprising: 

receiving user input indicating the relative importance of the features and the second 

feature . 

1 1 . The method of claim 8, wherein: 

at l e ast on e the feature and the second feature are each is represented by the a relative 
frequency of occurrence of a feature value each of s e veral values for th e f e atur e. 

12. The method of claim 8, wherein: 

information pertaining to the feature and information pertaining to the second feature 
the sot of features includes color information describing the relative frequency of occurrence 
of colors in an object. 

13. The method of claim 8, wherein: 



a information pertaining to the feature for a first obj e ct type is mapped to a 
information pertaining to the second feature for a second object type . 
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14. The method of claim 1, further comprising: 

combining object information pertaining to the feature for an additional reference 
object with the composite reference information to revise the composite reference 
information. 

15. The method of claim 14, wherein: 

the additional reference is a media object identified by comparing the composite 
reference information to object information fef pertaining to the feature for each respective 
one of the plurality of media objects. 

16. The method of claim 14, further comprising: 

comparing the revised composite reference information to obj e ct information for the 
feature for each of a second plurality of media objects in the collection of media objects. 

17. The method of claim 1, wherein: 

comparing the composite reference information to Qbject information pertaining to the 
same feature for each respective one of a plurality of fef media objects in a collection of 
media objects includes assigning a similarity value to each respective one of the media 
objects in the collection of media objects, the each similarity value indicating the similarity of 
the object information for the media object and te the composite reference information. 

18. The method of claim 1 7, wherein: 



the each similarity value of each of the media objects in the collection of media 
objects is less than or equal to a similarity value calculated for each reference object. 
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19. The method of claim 17, further comprising: 

ranking the media objects according to their similarity values; and 

wh e rein selecting one or more a media objects in the collection of media objects 
based upon the comparison of the object information and tho composite reference information 
includes selecting a media object based upon its rank. 



20. The method of claim 8, wherein: 

for each reference and media object, the obj e ct information pertaining to for e ach of 
the feature and the information pertaining to the second feature refer e nc e and media objects is 
expressed as a feature vector of componentsi-and 

each feature vector includ e s on e or mor e components representing a f e ature of the 
corresponding reference or media object . 

2 1 . The method of claim 20, wherein: 

combining object information pertaining to a feature and combining information 
pertaining to a second feature common to fer a plurality of reference objects includes 
combining the feature vectors of the plurality of reference objects to produce a composite 
reference vector. 
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22. The method of claim 21, wherein: 

each feature vector includes one or more components representing metadata 
associated with the corresponding reference or media object; and 

combining obj e ct information pertaining to a feature and combining information 
pertaining to a second feature common to fef a plurality of reference objects includes 
combining components representing a the feature or the second feature of part or all of each 
roforonco object according to a first combination function and combining the one or more 
components representing metadata associated with pan or all of each reference object 
according to a second combination function. 

23 . The method of claim 2 1 , further comprising: 

defining a weighting vector for the feature and the second feature one or more of the 
features , the weighting vector specifying a relative importance for the corresponding features; 

wherein combining the feature vectors includes using the weighting vector to specify 
a relative importance of the features. 

25. The method of claim 21 , wherein: 

comparing the composite reference information to object information fef pertaining to 
the same feature for each respective one of a plurality of media objects in a collection of 
media objects includes comparing the composite reference vector to the a feature vectors of 
each of a the plurality of media objects in the collection of media objects. 
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27. The method of claim 1, wherein: 

combining object information for pertaining to a feature common to a plurality of 
reference objects includes using a combination function; 

comparing the composite reference information to object information pertaining to the 
same feature for each respective one of a plurality of fer media objects in a collection of 
media objects includes using a comparison function that is based upon the combination 
function. 

28. Th e m e thod of claim 1. wh e r e in A method for searching a collection of media 
objects, comprising : 

combining the obj e ct information pertaining to two or more features common to a 
plurality of reference objects to produce composite reference information representing criteria 
for a search, wherein the information characterizes features of the reference objects and the 
media objects in the collection of media objects and is expressed as a feature vector of 
componentst and 

combining object information for a plurality of reference objects includes combining 
the feature vectors of the plurality of reference objects using a Min or Max function to 
produce a composite reference vector; and 

comparing the composite reference information to object information pertaining to the 
same feature for each respective one of a plurality of for the media objects in the collection of 
media objects , wherein comparing includes comparing the composite reference vector to the 
feature vectors of each media object in the collection of media objects using a Min or Max 
function and assigning a similarity value to each media object in the collection of media 
objects, the similarity value indicating the similarity of the feature vector of the media object 
to the composite reference vector, where the similarity value of each of the media objects in 
the collection of media objects is less than or equal to a similarity value calculated for each 
reference object. 
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29. A computer program product on a computer-readable medium, for searching a 
collection of media objects, the computer program comprising instructions operable to cause 
a programmable processor to: 

combine object information pertaining to a feature common to fef a plurality of 
reference objects to produce composite reference information representing criteria for a 
search; 

compare the composite reference information to object information pertaining to the 
same feature for each respective one of a plurality of for media objects in a collection of 
media objects to identify one or more media objects in the collection of m e dia object s; 

wherein a non-Euclidian function is used either to combine the information pertaining 
to the feature, or to compare the composite reference information to information pertaining to 
the same feature. 



3 1 . The computer program product of claim 29, further comprising instructions 
operable to cause a programmable processor to: 

select a media object in the collection of media objects based upon the comparison of 
the object information pertaining to the feature for each media object and the composite 
reference information. 



33. The computer program product of claim 32, wherein: 

instructions to combine object information pertaining to a feature common to fer a 
plurality of reference objects include instructions to combine object information for different 
types of objects. 
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34. The computer program product of claim 29, wherein: 



instructions to combine object information pertaining to a feature common to fef a 
plurality of reference objects to produce composite reference information include instructions 
to determine the intersection of the object information for the reference objects. 



35. The computer program product of claim 29, wherein: 

instructions to combine object information pertaining to a feature common to -fef a 
plurality of reference objects to produce composite reference information include instructions 
to determine the union of the object information for the reference objects. 



36. The computer program product of claim 29, wh e r e in further comprising : 

instructions to combine the obj e ct information pertaining to a second feature common 
to the plurality of reference objects to produce additional composite reference information 
representing criteria for the search; and characterizes two or more features of the reference 
objects and the media objects in th e collection of media objects. 

instructions to compare the additional composite reference information to information 
pertaining to the second feature for each respective one of the plurality of media objects in 
the collection of media objects to identify one or more media objects. 

37. The computer program product of claim 36, wherein: 

the object information pertaining to a feature and the information pertaining to a 
second feature is weighted to specify a relative importance of the features. 
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38. The computer program product of claim 36, further comprising instructions 
operable to cause a programmable processor to: 

receive user input indicating the relative importance of the features and the second 

feature . 

39. The computer program product of claim 36, wherein: 

at least one the feature and the second feature are each is represented by the a relative 
frequency of occurrence of a feature value each of several values for the f e ature . 

40. The computer program product of claim 36, wherein: 

information pertaining to the feature and information pertaining to the second feature 
the set of features includes color information describing the relative frequency of occurrence 
of colors in an object. 

41 . The computer program product of claim 36, wherein: 

a information pertaining to the feature for a first object type is mapped to a 
information pertaining to the second feature for a s e cond object type . 

42. The computer program product of claim 29, further comprising instructions 
operable to cause a programmable processor to: 



combine object information pertaining to the feature for an additional reference object 
with the composite reference information to revise the composite reference information. 
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43. The computer program product of claim 42, wherein: 

the additional reference is a media object identified by comparing the composite 
reference information to object information pertaining to the feature for each respective one 
of the plurality of f er media objects. 

44. The computer program product of claim 42, further comprising 
instructions operable to cause a programmable processor to: 

compare the revised composite reference information to object information for the 
feature for each of a second plurality of media objects in the collection of media objects. 

45. The computer program product of claim 29, wherein: 

instructions to compare the composite reference information to obj e ct information 
pertaining to the same feature for each respective one of a plurality of fer media objects in a 
collection of media objects include instructions to assign a similarity value to each respective 
one of the media objects in the collection of media objects, the each similarity value 
indicating the similarity of the object information for the media object and the composite 
reference information. 

46. The computer program product of claim 45, wherein: 



the each similarity value of each of the media objects in the collection of media 
objects is less than or equal to a similarity value calculated for each reference object. 
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47. The computer program product of claim 45, further comprising instructions 
operable to cause a programmable processor to: 

rank the media objects according to their similarity values; and 

wher e in instructions to select one or more a media objects in the collection of media 
objects based upon the comparison of the object information and the composite reference 
information include instructions to s elect a media object based upon its rank. 

48. The computer program product claim 36, wherein: 

for each reference and media object, the object information pertaining to for e ach of 
the feature and the information pertaining to the second feature r e fer e nc e and media objects is 
expressed as a feature vector of components ; and 

each featur e v e ctor incl udes one or mor e compon e nts r e pr e senting a feature of the 
corresponding reference or media object . 

49. The computer program product of claim 48, wherein: 

instructions to combine object information pertaining to a feature and instructions to 
combine information pertaining to a second feature common to fer a plurality of reference 
objects include instructions to combine the feature vectors of the plurality of reference 
objects to produce a composite reference vector. 
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50. The computer program product of claim 49, wherein: 

each feature vector includes one or more components representing metadata 
associated with the corresponding reference or media object; and 

combining object information pertaining to a feature and combining information 
pertaining to a second feature common to fe*= a plurality of reference objects includes 
combining components representing a the feature or the second feature of part or all of each 
roforonco object according to a first combination function and combining the one or more 
components representing metadata associated with part or all of each reference object 
according to a second combination function. 

5 1 . The computer program product of claim 49, further comprising instructions 
operable to cause a programmable processor to: 

define a weighting vector for the feature and the second feature one or more of the 
features , the weighting vector specifying a relative importance for the corresponding features; 

wherein instructions to combine the feature vectors include instructions to use the 
weighting vector to specify a relative importance of the features. 

53. The computer program product of claim 49, wherein: 

instructions to compare the composite reference information to object information 
pertaining to the same feature for each respective one of a plurality of fe r media objects in a 
collection of media objects include instructions to compare the composite reference vector to 
the a feature vectors of each of a the plurality of media objects in the collection of media 
objects. 
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55. The computer program product of claim 29, wherein: 

instructions to combine obj e ct information pertaining to a feature common to fef a 
plurality of reference objects include instructions to use a combination function; 

instructions to compare the composite reference information to obj e ct information 
pertaining to the same feature for each respective one of a plurality of fee media objects in a 
collection of media objects include instructions to use a comparison function that is based on 
the combination function. 



56. A computer program product on a computer-readable medium, for searching a 
collection of media objects, the computer program comprising instructions operable to cause 
a programmable processor to The computer program product of claim 29, wherein : 

combine the object information pertaining to two or more features common to a 
plurality of reference objects to produce composite reference information representing criteria 
for a search, wherein the information characterizes features of the reference objects and the 
media objects in the collection of media objects and is expressed as a feature vector of 
components^ and 

the instructions to combine ing object information for a plurality of r e fer e nc e obj e cts 
includes instructions to combineiag the feature vectors of the plurality of reference objects 
using a Min or Max function to produce a composite reference vector; and 

compareiftg the composite reference information to object information pertaining to 
the same feature for each respective one of a plurality of fe r the media objects in the 
collection of media objects includes comparing the composite reference vector to the feature 
vectors of each media object in the collection of media objects using a Min or Max function 
and assigning a similarity value to each media object in the collection of media objects, the 
similarity value indicating the similarity of the feature vector of the media object to the 
composite reference vector, where the similarity value of each of the media objects in the 
collection of media objects is less than or equal to a similarity value calculated for each 
reference object. 
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57. A system for searching a collection of media objects, comprising: 

means for combining object information pertaining to a feature common to fer a 
plurality of reference objects to produce composite reference information representing criteria 
for a search; aftd 

means for comparing the composite reference information to object information 
pertaining to the same feature for each respective one of a plurality of fef media objects in a 
collection of media objects to identify one or more media objects in the collection of media 
obj e cts ; 

wherein a non-Euclidian function is used either to combine the information pertaining 
to the feature, or to compare the composite reference information to information pertaining to 
the same feature. 

58. The system of claim 57, wherein: 

means for comparing the composite reference information to object information 
pertaining to the same feature for each respective one of a plurality of fef media objects in the 
collection of media objects includes means for assigning a similarity value to each respective 
one of the media objects in the collection of media objects, each the similarity value 
indicating the similarity of the object information for the media object and te the composite 
reference information, wherein the similarity value of each of the media objects in the 
collection of media objects is less than or equal to a similarity value calculated for each 
reference object. 
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59. A system for searching a collection of media objects, comprising Th e syst e m 
of claim 57, wh e r e in : 

means for combining the object information pertaining to two or more features 
common to a plurality of reference objects to produce composite reference information 
representing criteria for a search, wherein the information characterizes features of the 
reference objects and the media objects in the collection of media objects and is expressed as 
a feature vector of components^ 

means for combining object information for a plurality of reference objects and means 
for combining includes means for combining the feature vectors of the plurality of reference 
objects to produce a composite reference vector; and 

means for comparing the composite reference information to object information 
pertaining to the same two or more features for each respective one of a plurality of fer media 
objects in a collection of media objects , wherein the means for comparing includes means for 
comparing the composite reference vector to the feature vectors of each of the media objects 
in the collection of media objects. 



Please also replace the existing abstract with the following abstract: 

Methods and apparatus implementing a technique for searching media objects. In 
general, in one aspect, the technique includes receiving user input specifying a plurality of 
reference objects, defining a feature common to them, and combining information pertaining 
to the feature to generate composite reference information defining criteria for a search. The 
technique includes comparing the composite reference information to information pertaining 
to the same feature for each media object in a collection of media objects, and selecting a 
media object based upon the comparison. A non-Euclidean function is used either to combine 
or compare the information pertaining to the feature. 
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Remarks 



The applicant has amended claims 1, 3, 5-23, 25, 27-29, 31, 33-51, 53, and 55-59, and 
the abstract. 

Independent claims 1, 29 and 57 are amended to more clearly indicate that the recited 
combining and comparing of information is combining and comparing of information 
pertaining to a feature that is common to a plurality of reference media objects and which 
occurs in each respective one of a plurality of media objects in a collection of media objects. 
Independent claims 1, 29 and 57 are also amended to specify that a non- Euclidian function is 
used either to combine or compare the information pertaining to the feature. 

Claims 3, 5-7, 14-17, 20, 25, 27; 31, 33-35, 42-45, 48, 53, 55; and 58 depend on 
claims 1, 29, and 57, respectively, and each is amended in the same was as the respective 
independent claim. 

Claims 8, 36, and 59 are amended to reject the more clear language of amended 
claims 1, 29, or 57, respectively, and are also amended to explicitly recite combining and 
comparing a feature and a second feature, rather than simply reciting "features". Claims 9-13, 
16, 20-23, and 28; and claims 37-41, 44, 48-51, and 56 depend from claims 8 and 36, 
respectively, and are amended in accordance with the amendments to claims 8 and 36. 

Claims 1 1, 13, 17-18, 19, 22, 25; and 39, 41, 45-47, 50, 53 are amended to correct and 
clarify the language of the claims. The abstract is amended to reflect the changes to claim 1. 

Attached are replacement pages 41 through 56 reflecting the above amendments. 

Please apply any charges or credits to Deposit Account No. 06-1050. 
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What is claimed is: 

1 . A method for searching a collection of media objects, comprising: 

combining information pertaining to a feature common to a plurality of reference 
objects to produce composite reference information representing criteria for a search; and 

comparing the composite reference information to information pertaining to the 
same feature for each respective one of a plurality of media objects in a collection of 
media objects to identify one or more media objects; 

wherein a non-Euclidian function is used either to combine the information 
pertaining to the feature, or to compare the composite reference information to information 
pertaining to the same feature. 

2. The method of claim 1, further comprising: 
receiving user input specifying the plurality of reference objects. 

3. The method of claim 1, further comprising: 

selecting a media object in the collection of media objects based upon the 
comparison of the information pertaining to the feature for each media object and the 
composite reference information. 

4. The method of claim 1, wherein: 

the plurality of reference objects includes one or more objects having a type 
selected from: audio, image, text, CD, or video. 
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5. 



The method of claim 4, wherein: 



combining information pertaining to a feature common to a plurality of reference 
objects includes combining information for different types of objects. 

6. The method of claim 1, wherein: 

combining information pertaining to a feature common to a plurality of reference 
objects to produce composite reference information includes determining the intersection 
of the information for the reference objects. 

7. The method of claim 1, wherein: 

combining information pertaining to a feature common to a plurality of reference 
objects to produce composite reference information includes determining the union of the 
information for the reference objects. 

8. The method of claim 1 , further comprising: 

combining information pertaining to a second feature common to the plurality of 
reference objects to produce additional composite reference information representing 
criteria for the search; and 

comparing the additional composite reference information to information 
pertaining to the second feature for each respective one of the plurality of media objects in 
the collection of media objects to identify one or more media objects. 

9. The method of claim 8, wherein: 

the information pertaining to a feature and the information pertaining to a second 
feature is weighted to specify a relative importance of the features. 
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10. The method of claim 8, further comprising: 

receiving user input indicating the relative importance of the feature and the second 

feature. 

1 1 . The method of claim 8, wherein: 

the feature and the second feature are each represented by a relative frequency of 
occurrence of a feature value. 

12. The method of claim 8, wherein: 

information pertaining to the feature and information pertaining to the second 
feature includes color information describing the relative frequency of occurrence of colors 
in an object. 

13. The method of claim 8, wherein: 

information pertaining to the feature is mapped to information pertaining to the 
second feature. 

14. The method of claim 1, further comprising: 

combining information pertaining to the feature for an additional reference object 
with the composite reference information to revise the composite reference information. 
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15. The method of claim 14, wherein: 

the additional reference is a media object identified by comparing the composite 
reference information to information pertaining to the feature for each respective one of 
the plurality of media objects. 

16. The method of claim 14, further comprising: 

comparing the revised composite reference information to information for the 
feature for each of a second plurality of media objects in the collection of media objects. 

17. The method of claim 1, wherein: 

comparing the composite reference information to information pertaining to the 
same feature for each respective one of a plurality of media objects in a collection of 
media objects includes assigning a similarity value to each respective one of the media 
objects in the collection of media objects, each similarity value indicating the similarity of 
the information for the media object and the composite reference information. 

1 8. The method of claim 1 7, wherein: 

each similarity value of each of the media objects in the collection of media objects 
is less than or equal to a similarity value calculated for each reference object. 

19. The method of claim 1 7, further comprising: 

ranking the media objects according to their similarity values; and 

selecting one or more media objects in the collection of media objects based upon 
its rank. 
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20. The method of claim 8, wherein: 

for each reference and media object, the information pertaining to the feature and 
the information pertaining to the second feature is expressed as a feature vector of 
components. 

21 . The method of claim 20, wherein: 

combining information pertaining to a feature and combining information 
pertaining to a second feature common to a plurality of reference objects includes 
combining the feature vectors of the plurality of reference objects to produce a composite 
reference vector. 

22. The method of claim 21, wherein: 

each feature vector includes one or more components representing metadata 
associated with the corresponding reference or media object; and 

combining information pertaining to a feature and combining information 
pertaining to a second feature common to a plurality of reference objects includes 
combining components representing the feature or the second feature according to a first 
combination function and combining the one or more components representing metadata 
associated with each reference object according to a second combination function. 

23. The method of claim 21, further comprising: 

defining a weighting vector for the feature and the second feature, the weighting 
vector specifying a relative importance for the corresponding features; 

wherein combining the feature vectors includes using the weighting vector to 
specify a relative importance of the features. 
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24. The method of claim 21, wherein: 

combining the feature vectors includes using a Min or Max function. 

25. The method of claim 21, wherein: 

comparing the composite reference information to information pertaining to the 
same feature for each respective one of a plurality of media objects in a collection of 
media objects includes comparing the composite reference vector to a feature vector of 
each of the plurality of media objects in the collection of media objects. 

26. The method of claim 25, wherein: 

comparing the composite reference vector to the feature vectors of each of a 
plurality of media objects includes using a Min or Max function. 

27. The method of claim 1, wherein: 

combining information pertaining to a feature common to a plurality of reference 
objects includes using a combination function; 

comparing the composite reference information to information pertaining to the 
same feature for each respective one of a plurality of media objects in a collection of 
media objects includes using a comparison function that is based upon the combination 
function. 
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28. A method for searching a collection of media objects, comprising: 

combining information pertaining to two or more features common to a plurality of 
reference objects to produce composite reference information representing criteria for a 
search, wherein the information is expressed as a feature vector of components and 

combining includes combining the feature vectors of the plurality of reference objects 
using a Min or Max function to produce a composite reference vector; and 

comparing the composite reference information to information pertaining to the 
same feature for each respective one of a plurality of the media objects in the collection of 
media objects, wherein comparing includes comparing the composite reference vector to 
the feature vectors of each media object in the collection of media objects using a Min or 
Max function and assigning a similarity value to each media object in the collection of 
media objects, the similarity value indicating the similarity of the feature vector of the 
media object to the composite reference vector, where the similarity value of each of the 
media objects in the collection of media objects is less than or equal to a similarity value 
calculated for each reference object. 

29. A computer program product on a computer-readable medium, for 
searching a collection of media objects, the computer program comprising instructions 
operable to cause a programmable processor to: 

combine information pertaining to a feature common to a plurality of reference 
objects to produce composite reference information representing criteria for a search; 

compare the composite reference information to information pertaining to the same 
feature for each respective one of a plurality of media objects in a collection of media 
objects to identify one or more media objects; 

wherein a non-Euclidian function is used either to combine the information 
pertaining to the feature, or to compare the composite reference information to information 
pertaining to the same feature. 
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30. The computer program product of claim 29, further comprising instructions 
operable to cause a programmable processor to: 

receive user input specifying the plurality of reference objects. 

3 1 . The computer program product of claim 29, further comprising instructions 
operable to cause a programmable processor to: 

select a media object in the collection of media objects based upon the comparison 
of the information pertaining to the feature for each media object and the composite 
reference information. 

32. The computer program product of claim 29, wherein: 

the plurality of reference objects includes one or more objects having a type 
selected from: audio, image, text, CD, or video. 

33. The computer program product of claim 32, wherein: 

instructions to combine information pertaining to a feature common to a plurality 
of reference objects include instructions to combine information for different types of 
objects. 

34. The computer program product of claim 29, wherein: 

instructions to combine information pertaining to a feature common to a plurality 
of reference objects to produce composite reference information include instructions to 
determine the intersection of the information for the reference objects. 
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35. The computer program product of claim 29, wherein: 

instructions to combine object information pertaining to a feature common to a 
plurality of reference objects to produce composite reference information include 
instructions to determine the union of the information for the reference objects. 

36. The computer program product of claim 29, further comprising: 

instructions to combine information pertaining to a second feature common to the plurality 
of reference objects to produce additional composite reference information representing 
criteria for the search; and 

instructions to compare the additional composite reference information to 
information pertaining to the second feature for each respective one of the plurality of 
media objects in the collection of media objects to identify one or more media objects. 

37. The computer program product of claim 36, wherein: 

the information pertaining to a feature and the information pertaining to a second 
feature is weighted to specify a relative importance of the features. 

38. The computer program product of claim 36, further comprising instructions 
operable to cause a programmable processor to: 

receive user input indicating the relative importance of the feature and the second 

feature. 

39. The computer program product of claim 36, wherein: 

the feature and the second feature are each represented by a relative frequency of 
occurrence of a feature value. 
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40. The computer program product of claim 36, wherein: 

information pertaining to the feature and information pertaining to the second 
feature includes color information describing the relative frequency of occurrence of colors 
in an object. 

41. The computer program product of claim 36, wherein: 

information pertaining to the feature is mapped to information pertaining to the second 
feature. 



42. The computer program product of claim 29, further comprising instructions 
operable to cause a programmable processor to: 

combine information pertaining to the feature for an additional reference object 
with the composite reference information to revise the composite reference information. 

43. The computer program product of claim 42, wherein: 

the additional reference is a media object identified by comparing the composite reference 
information to information pertaining to the feature for each respective one of the plurality 
of media objects. 

44. The computer program product of claim 42, further comprising instructions 
operable to cause a programmable processor to: 

compare the revised composite reference information to information for the feature 
for each of a second plurality of media objects in the collection of media objects. 
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45. The computer program product of claim 29, wherein: 

instructions to compare the composite reference information to information 
pertaining to the same feature for each respective one of a plurality of media objects in a 
collection of media objects include instructions to assign a similarity value to each 
respective one of the media objects in the collection of media objects, each similarity value 
indicating the similarity of the information for the media object and the composite 
reference information. 

46. The computer program product of claim 45, wherein: 

each similarity value of each of the media objects in the collection of media objects 
is less than or equal to a similarity value calculated for each reference object. 

47. The computer program product of claim 45, further comprising instructions 
operable to cause a programmable processor to: 

rank the media objects according to their similarity values; and 

select one or more media objects in the collection of media objects based upon its rank. 

48. The computer program product claim 36, wherein: 

for each reference and media object, the information pertaining to the feature and 
the information pertaining to the second feature is expressed as a feature vector of 
components. 
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49. The computer program product of claim 48, wherein: 

instructions to combine information pertaining to a feature and instructions to 
combine information pertaining to a second feature common to a plurality of reference 
objects include instructions to combine the feature vectors of the plurality of reference 
objects to produce a composite reference vector. 

50. The computer program product of claim 49, wherein: 

each feature vector includes one or more components representing metadata 
associated with the corresponding reference or media object; and 

combining information pertaining to a feature and combining information 
pertaining to a second feature common to a plurality of reference objects includes 
combining components representing the feature or the second feature according to a first 
combination function and combining the one or more components representing metadata 
associated with each reference object according to a second combination function. 

5 1 . The computer program product of claim 49, further comprising instructions 
operable to cause a programmable processor to: 

define a weighting vector for the feature and the second feature, the weighting 
vector specifying a relative importance for the corresponding features; 

wherein instructions to combine the feature vectors include instructions to use the 
weighting vector to specify a relative importance of the features. 

52. The computer program product of claim 49, wherein: 

instructions to combine the feature vectors include instructions to use a Min or Max 
function. 



52 



# • 

53. The computer program product of claim 49, wherein: 

instructions to compare the composite reference information to information 
pertaining to the same feature for each respective one of a plurality of media objects in a 
collection of media objects include instructions to compare the composite reference vector 
to a feature vector of each of the plurality of media objects in the collection of media 
objects. 

54. The computer program product of claim 53, wherein: 

instructions to compare the composite reference vector of the reference object to 
the feature vectors of each of a plurality of media objects include instructions to use a Min 
or Max function. 

55. The computer program product of claim 29, wherein: 

instructions to combine information pertaining to a feature common to a plurality 
of reference objects include instructions to use a combination function; 

instructions to compare the composite reference information to information 
pertaining to the same feature for each respective one of a plurality of media objects in a 
collection of media objects include instructions to use a comparison function that is based 
on the combination function. 
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56. A computer program product on a computer-readable medium, for 
searching a collection of media objects, the computer program comprising instructions 
operable to cause a programmable processor to: 

combine information pertaining to two or more features common to a plurality of 
reference objects to produce composite reference information representing criteria for a 
search, wherein the information is expressed as a feature vector of components and the 
instructions to combine include instructions to combine the feature vectors of the plurality 
of reference objects using a Min or Max function to produce a composite reference vector; 
and 

compare the composite reference information to information pertaining to the same 
feature for each respective one of a plurality of the media objects in the collection of media 
objects includes comparing the composite reference vector to the feature vectors of each 
media object in the collection of media objects using a Min or Max function and assigning 
a similarity value to each media object in the collection of media objects, the similarity 
value indicating the similarity of the feature vector of the media object to the composite 
reference vector, where the similarity value of each of the media objects in the collection 
of media objects is less than or equal to a similarity value calculated for each reference 
object. 

57. A system for searching a collection of media objects, comprising: 

means for combining information pertaining to a feature common to a plurality of 
reference objects to produce composite reference information representing criteria for a 
search; 

means for comparing the composite reference information to information 
pertaining to the same feature for each respective one of a plurality of media objects in a 
collection of media objects to identify one or more media objects; 

wherein a non-Euclidian function is used either to combine the information 
pertaining to the feature, or to compare the composite reference information to information 
pertaining to the same feature. 
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58. The system of claim 57, wherein: 



means for comparing the composite reference information to information 
pertaining to the same feature for each respective one of a plurality of media objects in the 
collection of media objects includes means for assigning a similarity value to each 
respective one of the media objects in the collection of media objects, each similarity value 
indicating the similarity of the information for the media object and the composite 
reference information, wherein the similarity value of each of the media objects in the 
collection of media objects is less than or equal to a similarity value calculated for each 
reference object. 

59. A system for searching a collection of media objects, comprising: 

means for combining information pertaining to two or more features common to a 
plurality of reference objects to produce composite reference information representing 
criteria for a search, wherein the information is expressed as a feature vector of 
components and means for combining includes means for combining the feature vectors of 
the plurality of reference objects to produce a composite reference vector; and 

means for comparing the composite reference information to information 
pertaining to the same two or more features for each respective one of a plurality of media 
objects in a collection of media objects, wherein the means for comparing includes means 
for comparing the composite reference vector to the feature vectors of each of the media 
objects in the collection of media objects. 
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REDUCTION OF SEARCH AMBIGUITY WITH MULTIPLE MEDIA 



REFERENCES 



ABSTRACT OF THE DISCLOSURE 



Methods and apparatus implementing a technique for searching media objects. In 
general, in one aspect, the technique includes receiving user input specifying a plurality of 
reference objects (2), defining a feature common to them, and combining information 
pertaining to the feature to generate composite reference information (4) defining criteria 
for a search . The technique includes comparing the composite reference information to 
information pertaining to the same feature for each media object in a collection of media 
objects (10), and selecting a media object based upon the comparison (16). A non- 
Euclidean function is used either to combine or compare the information pertaining to the 
feature. 
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